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CLAIMS 

What is claimed is: 

1. A method for visually annotating a digital image, said digital image being raster 
based/ said method comprising the steps of: 

5 providing a digital image; 

annotating said digital image; 

storing electronically said annotations as vector based information linked to said 
digital image such that the digital image remains in a substantially unaltered condition; and 
rendering said digital image with the annotations for display such that the annotations 
.0 can be perceived by a user* 

2. The method of claim 1, wherein the digital image is an image of at least a portion of 

a human body. . _ , 

3. The method of claim 2, wherein the step of annotating the digital image includes the 
step of defining a region of interest and adding textual information. 

^5 " 4. The method of claim 1, wherein the step of storing comprises storing said 
annotations in a second file and said digital image is stored in a first file. 

5. The method of claim 1, wherein the step of storing comprises storing said annotations, 
in the same file which contains the digital image. 

6. The method of claim 1, wherein step of storing comprises storing said annotations as 
>0 text information. 

7. The method of claim 6, wherein the annotations are stored in an XML compatible 

format method of claim 1, wherein said annotations comprise at least one member selected 

from the' group consisting of a region of interest, a pointer, a symbol, a caption, a label and 
>5 an abbreviation. , 

9. The method of claim 8, further comprising the step of hierarchically organizing the 
annotations into logical groupings pursuant to a user defined structure. 

10. The method of claim 8, wherein at least part of the annotation utilizes user defined 

lexicons « • 
30 11. The method of claim 1, wherein metadata is also stored along with the annotations. 

12. The method of claim 1, wherein the annotation comprises a region of interest, said 
region of interest being defined by one selected from the group consisting of: a set of points, 
a polygon, and a polyline. , , ^ . 

13. The method of claim 1 wherein the step of rendering the image with the annotations 
35 comprises the step of displaying the annotations in a context appropriate display. 

14. The method of claim 1 wherein each of the annotations can be selectively chosen for 
display on the digital image during the rendering step. 

15. The method of claim 1 wherein each of the annotations can be displayed according to 
a predefined user grouping. t , 

10 16. The method of claim 1 wherein the annotations are uniquely identified. 

17. The method of claim 1 wherein the digital image comprises a sequence of digital 

images . .... 

18. A method for interactively displaying annotations linked to a digital image, the 
annotations stored as vector information, said method comprising the steps of: 

45 selecting and displaying the digital image on a display; and 

generating a graphical user interface on the display to accept user preferences, said 
graphical user interface allowing a user to toggle on and off any grouping of the annotations 
through the graphical user interface, the annotations being visible when toggled on and hidden 
from view when toggled off. . 

50 19. The method of claim 18 wherein the digital image is a raster based image. 

20. The method of claim 18 wherein the graphical user interface further allows a user to 
activate and deactivate spatial contextual labels. 

21. The method of claim 18 wherein the graphical user interface allows a user to pan the 
digital image and zoom in and out. . - a 

55 22. The method of claim 18 wherein the graphical user interface allows a user to toggle 
on and off annotations from a particular author. 

23. The method of claim 18 wherein the graphical user interface allows a user to toggle 
on and off annotations from a particular specialty. 

24. The method of claim 18 wherein the groupings are predefined by the user. 

60 25. The method of claim 18 wherein the digital image remains in a substantially 

unaltered format. . 

26. The method of claim 18 wherein said annotations comprise at least one member 
selected from the group consisting of a region of interest, a pointer, a symbol, a caption, a 
label and an abbreviation, . 

65 27. The method of claim 26 wherein the annotations comprise entries from a previously 

defined lexicon. m , ^ _ 

28. A method for annotating a digital image, said method comprising the steps of: 
displaying a digital image on a computer display; 

annotating said digital image; 
70 grouping the annotations hierarchically pursuant to a user defined structure; ana 

storing said annotations as vector based information linked to said digital image such 
that the digital image remains in a substantially unaltered condition. 

29. The method of claim 28 wherein the step of grouping the annotations hierarchically 
allows the annotation to be displayed in context appropriately. 

75 30. The method of claim 28, wherein the annotations are saved in a format that can r>e 

electronically queried. . 4-^.,- 

31. The method of claim 30, wherein the annotations are capable of being retrieved for 

interactive display. 
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32 The method of claim 28 wherein metadata is s"Eo«recf ^cfe&^fttrtlie "artnot^±'b'te§ . 
33" The method of claim 32 wherein the metadata uniquely identifies the annotatxons. 
34" The method of claim 32 wherein the metadata comprises at least one selected from the 
arouo consisting of: the name of the author or creator of each of the annotations, a date 
5 indicating when annotation was added to the digital image, a title, a subject, a description, 
and an area of specialty of the author or creator. 

35. A method for managing digital images, said method comprising: 
inputting annotations for each of the digital images; 

saving each of the annotations in a textual format linked to the digital image such that 
10 the digital image remains substantially unaltered; 

generating a query, said query querying the annotations; 

retrieving the appropriate annotations and their linked digital images, if any, in 

response to the query; and 

displaying the retrieved digital images and their associated annotations. 
15 36. The method of claim 35 wherein the step of inputting annotations comprises defining 

a region of interest on each of the associated digital images. ^„« 4 «„ fho 

37. The method of claim 35 further comprising the step of hierarchically grouping the 
annotations pursuant to a user defined structure and the step of generating a query utilizing 

20 Sald ^Sl^i^S^SlUim 35 wherein the step of displaying the retrieved 

comprises the step of interactively displaying the annotations associated with the retrieved 

digital^ images^ q£ claLm 3Q where i n the annotations can be toggled on and off, said 

annotations being visible when toggled on and hidden from view when toggled off. 
25 annotat 4 1 £ ns ~ e £ ethQd Qf claim 3 | wh erein annotations can be displayed pursuant to a hierarchal 

grouping^ ^ system for visua n y annotating digital data stored in a electronic file, the 
SyStem a Tlx4 S ac\ g ion means for extracting data from the electronic file to create a visual 
30 »pr«^ the extracted data into a visual representation that 

reflects the digital data; „„, i „ 

a constructing means for permitting a human user to manually create dimensionally 

appropriate annotations^^ electronically gtoring the notations as vector information such 
that the digital data stored in the electronic file is substantially unaltered; and 

a presenting means for displaying the visual representation of the digxtal data along 
with the annotations^ ^ ^ ^ extraction means iden tifies the format of the 

40 electronic file based upon the electronic file extension, MIME type as embedded into the 

electronic file or provided externally as metadata, or user input. ^„<4.„i data is a 

43. The system of claim 41, wherein the visual representation of the digital data is a 
single visual data element that has the dimensions of the original data. . 
, 44. The system of claim 41, wherein the visual representation of the ,^^J-,«~ a " * 

45 sequence of visual data elements that each has the dimension of the original digital data, but 

has an additional dimension that defines a sequence axis. n-i^tai data is a 

45. The system of claim 41, wherein the visual representation of the digital data is a 
set of visual data elements that each has the dimension of the original digital data, but has an 
additional channel dimension where each visual data element represents the same conceptual 

50 space. wherein the visual representation of the digital data is a 

group of visual data elements that each has the dimension of the original digital data, but each 
visual data element is unique in the conceptual space that merits a grouping to visualize the 
similarities or differences of the visual elements. „,„v. 
similarities system of claim 41 further comprising an identifier means for marking each 

annotation with /ser identifying information to track ^authorship .of Ith. ^^ r ^^- 

48. The system of claim 41 wherein the presenting means is capable of restricting tne 
display of at least a portion of the annotations based upon previously defined viewing rights 

60 aSSi ^ d 9 . t0 The Ch sys S tem of claim 41 wherein the presenting means is capable of restricting the 
display of at least a portion of the annotations based upon user input. 
50. A system for annotating an image, said system comprising: 
means for storing a raster based digital image in a file; 
means for displaying said raster based digital image; 
R*> means for creatina vector based annotations related to said image; ana 

" means lor UnKng 9 said vector based annotations to said digital image ^1, that said 

annotations are related to said digital image and said digital image is preserved in its 
original^condition^^ ^ ^ comprising a presen ting means for displaying said 

70 *igital 5 image h ^ the presenting means furt her allows a user to 

selectively ^P^^J^^^^erein the annotations can be selectively displayed pursuant 
to a Predefined J^^^^JSSlB the annotations can be selectively displayed pursuant 
to by s P| cla ^y- system Qf cla . m 52 wherein the anno tations can be selectively displayed pursuant 
to user input received through a graphical user interface. 
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56. The system of claim 51 wherein the presenting Was' » ^hftfe&fett ^aH-OMtained 
user interface. 



